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Abstract 

We  present  a  state  space  description  for  cyclic  LTI  sys¬ 
tems  which  find  applications  in  cyclic  filter  banks  and 
wavelets.  We  also  revisit  the  notions  of  reachability  and 
observability  in  the  cyclic  context,  and  show  a  number  of 
important  differences  from  traditional  noncyclic  case.  A 
number  of  related  problems  such  as  the  paraunitary  inter¬ 
polation  problem  and  the  cyclic  paraunitary  factorizability 
problem  can  be  understood  in  a  unified  way  by  using  the 
realization  matrix  defined  by  the  state  space  description. 


application  in  cyclic  orthonormal  filter  banks  [9].  Unlike 
their  noncyclic  counterparts  it  has  been  shown  in  [10]  that 
cyclic  paraunitary  matrices  are  not  always  factorizable.  We 
return  to  this  in  Sec.  3. 

2.  CYCLIC  STATE-SPACE  DESCRIPTIONS 

Consider  a  cyclic  LTI  structure  with  N  cyclic  delay  ele¬ 
ments  (e.g.,  N  —  L  -  I  and  AT  =  1  in  Figs.  1  and  2, 
respectively).  We  can  identify  a  set  of  N  state  variables 
t;j(n)  (outputs  of  the  unit  delay  elements  Wt)  obtain 
equations  of  the  form 


1.  INTRODUCTION 

Cyclic  digital  filters  and  filter  banks  have  recently  been 
introduced  in  the  signal  processing  literature.  In  partic¬ 
ular,  the  fundamentals  of  cyclic  multirate  systems  are  in¬ 
troduced  in  [1,9],  and  the  concepts  applied  to  cyclic  filter 
banks.  Specific  detailed  problems  pertaining  to  wavelet 
construction  [2,3]  have  also  been  recently  addressed.  The 
applications  of  cyclic  filter  banks  in  image  coding  has  been 
pointed  out  in  [6,7].  In  this  paper  we  concentrate  on  state 
space  descriptions  of  cyclic  LTI  systems  and  point  out  sev¬ 
eral  departures  from  conventional  state  space  theory.  We 
also  revisit  the  cyclic  paraunitary  interpolation  problem 
[10]  and  the  cyclic  paraunitary  factorization  problem  from 
a  state  space  viewpoint  and  show  a  common  link  between 
these. 

The  input-output  description  for  a  cyclic(L)  LTI  system 
is  a  circular  convolution 

L-l 

y(n)  =  h(m)x(n  —  m) 

m—O 

where  the  time  arguments  are  interpreted  modulo  L.  The 
frequency  response  matrix  H(/c)  is  given  by  the  L-point 
DFT  of  the  impulse  response  matrix,  that  is  H(A:)  = 
h(Ti)W^"  where  Wl  =  The  quantity  Wj^ 

is  interpreted  as  a  unit  of  “cyclic-delay”,  and  is  used  in 
structures  representing  cyclic  systems.  Any  cyclic  LTI  sys¬ 
tem  can  be  drawn  in  nonrecursive  form  using  L  —  1  cyclic 
delays  as  in  Fig.  1,  but  sometimes  recursive  structures  are 
more  economic  [9].  The  recursive  cyclic  structure  in  Fig. 
2  has  the  frequency  response  H{k)  =  (ao  +  aiVF^)/(l  — 
6Vy^).  Implementing  such  a  recursive  structure  brings  up 
the  question  of  initial  conditions,  which  are  tricky  because 
of  the  cyclic  nature  of  time.  We  will  address  this  in  the 
more  general  setting  of  state  sp8w:e  descriptions. 

An  M  X  M  cyclic  transfer  matrix  E(A;)  is  said  to  be 
paraunitary  if  it  is  unitary  for  0  <  A:  <  L  —  1.  This  finds 
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v(n -I- 1)  =  Av(n) Bx(n)  (l(fl)) 

y(Ti)  =  Cv(n)  -{-  Dx(n)  (1(^)) 

where  v(n)  =  [vi(n)  V2{n)  ...  VN{n)]^  is  the  state 

vector.  Since  this  system  can  have  multiple  inputs  and 
outputs,  we  have  used  bold  letters  x(7i)  and  y(n)  above. 
Repeated  use  of  (1(a))  yields  v(L)  =  A^v(O)  -f  a  linear 
combination  of  samples  of  x(n).  Since  all  the  time-indices 
are  interpreted  modulo-L,  we  have  v(L)  =  v(0),  and 

(I  —  A^)v(O)  =  linear  combination  of  samples  of  x(n). 

Thus  we  can  identify  the  initial  state  v(0),  provided  I  — A^ 
is  nonsingular,  i.e.,  no  eigenvalue  of  A  has  the  form  for 
any  integer  m.  In  other  words,  the  eigenvalues  of  A  should 
not  be  at  the  unit-circle  points  indicated  in  Fig.  3.  This 
nonsingularity  condition  can  be  understood  in  another  way. 
If  we  evaluate  the  frequency  response  H(A:)  explicitly,  we 
have  the  form 

H(A:)  =  D  +  cfvK-''I-A'i  ‘b  = - - 

^  '  V  ^  J  det  -  A) 

The  eigenvalue  condition  on  A  implies  that  the  denom¬ 
inator  det  —  A)  is  nonzero  for  all  integers  k.  As 

long  as  this  is  satisfied,  H(fc)  is  defined  for  all  /c,  and  we 
can  uniquely  identify  an  “initial  state”  v(0)  for  any  input 
sequence  {x(n)}. 

Even  though  the  expression  for  H(/c)  resembles  the  non¬ 
cyclic  case  Hnon(2)  —  D  +  C{zl  —  A)’‘^B,  the  impulse 
response  matrix  h(n)  takes  a  slightly  different  form: 

{D  +  CA^“'fl-A^)  ^B  n  =  0 
/  ^ 

CA"-*MI-A^j  B  l<n<L-l 

(2) 

Notice,  for  example,  that  h(0)  ^  D,  which  is  a  departure 
from  the  noncyclic  case.  These  differences  arise  because  the 
initial  condition  v(0)  is  predetermined  as  explained  earlier, 
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and  cannot  be  set  to  zero  (as  we  would  in  the  noncyclic 
case).  Though  the  computation  of  v(0)  in  general  requires 
an  initial  overhead,  such  a  computation  followed  by  the 
recursive  computation  of  y(n)  as  in  EJq.  (1)  is  often  more 
economic  than  direct  or  FFT-based  circular  convolution  of 
x(n)  and  h(n). 

Similarity  transformations.  If  we  define  a  new  state 
space  description  by  using  the  familiar  similarity  transform 
Ai  =:  T“^AT,Bi  =  T“^B,Ci  =  CT,  the  new  system 
(Ai,Bi,Ci,D)  has  the  same  h(n).  Reason:  we  can  verify 

by  substitution  that  C A”" B  is  unchanged  by 

the  similarity  transform  for  any  u  >  1.  Thus  we  can  find 
equivalent  cyclic  state  space  realizations  by  using  similarity 
transforms.  Note  that  D  is  unchanged  by  the  transform. 

2.1.  Reachability 

The  ideas  of  reachability  and  observability  [5],  [8]  can  be 
extended  to  cyclic  LTI  systems  but  there  are  some  dif¬ 
ferences  from  the  traditional  noncyclic  case.  For  example 
we  will  see  that  reachability  and  observability  together  do 
not  imply  minimality.  The  cyclic  LTI  system  is  said  to 
be  reachable  if  we  can  arrive  at  any  chosen  final  value  V/ 
for  the  state  vector  v(n)  at  any  chosen  time  n  by  proper 
choice  of  the  input  sequence  x(.).  To  quantify  this  consider 
the  state  recursion  v(n  -h  1)  =  Av(n)  -h  Bx(n)  again.  If 
we  apply  this  L  times  and  use  the  periodicity  conditions 
v(n  -f-  L)  =  v(n)  and  x(n  +  L)  =  x(ti)  we  find 

’’x(n  —  1) ' 

^  x(n-2) 

(I- A^)v(n)  =  [B  AB  ...  A^-'B] 

> - - - ✓ 


this,  but  we  might  still  be  able  to  perform  a  re¬ 
duction  of  the  cyclic  state  space  equations  as  we 
shall  demonstrate  below. 


2.2.  Observability 

State-observability  in  a  cyclic  LTI  system  can  also  be  de¬ 
fined  similar  to  the  traditional  case,  but  with  some  subtle 
distinctions  between  the  cases  N  <  L  and  N  >  L.  First  as¬ 
sume  N  <  L.  The  output  equation  y(n)  =  Cv(n)  -fDx(n) 
can  be  repeatedly  applied  to  yield 


y(n) 

r  C  1 

y(n  + 1) 

CA 

_y(n  +  ’iV-l). 

S 

(4) 


where  f  depends  on  x(n),  x(n  -f  1),  . .  .x(n  N  —  1).  The 
initial  state  v(n)  can  be  uniquely  found  from  the  N  samples 
of  the  input  and  output  in  this  equation,  as  long  as  the 
matrix  Sc,a{1^),  which  has  N  columns,  has  rank  N,  If 
N  >  Ly  the  preceding  equation  is  not  meaningful  because 
y(t)  and  x(i)  repeat  with  period  L,  In  this  case,  however, 
we  have  a  very  unusual  situation.  If  the  input  and  output 
are  known  for  all  L  values  of  time,  then  in  particular  x(i)  is 
known  for  all  i  and  we  can  identify  the  state  v(n)  for  all  n 
using  the  state  recursion.  Thus  the  notion  of  observability 
becomes  trivial  for  N  >  L. 

Example  1 

Consider  the  cyclic  system 

H{k)  =  1  +  aW^  +  +  . . .  + 


Here  we  have  used  the  notation  that  for  any  integer  i  >  0, 

AB  ...  A‘-‘B]  (3) 

Let  N  denote  the  state  dimension  (size  of  v(n))  and  r  the 
number  of  inputs  (size  of  x(n)).  Then  is  a  N  xir 

matrix  with  rank  <  N,  The  matrix  7^>i,b(L),  in  particular, 
has  size  NxLr.  Assume  (I  — A^)  is  nonsingular  for  reasons 
explained  earlier.  It  is  then  clear  that  we  can  attain  any 
value  for  the  state  v(n)  at  any  time  n  by  application  of  a 
suitable  input  x(n  —  1),  x(n  —  2), ... ,  x(n  —  L)  if  and  only 
if  the  matrix  T^a,b{I^)  Has  rank  N,  This  gives  a  test  for 
reachability.  Now  two  cases  should  be  distinguished: 

1.  Let  N  <  L,  Then  the  rank  of  'Ra,b{N)  =  rank  of 
'R'A,b{L)  (Cayley-Hamilton  theorem),  and  the  reacha¬ 
bility  test  reduces  to  the  conventional  one.  Moreover, 
in  the  nonreachable  caise  we  can  perform  the  usual 
state  reduction. 

2.  Let  N  >  L.  This  is  possible  in  the  mimo  case  (e.g.,  if 
H(A:)  =  W^lry  then  N  r  regardless  of  L).  For  this 
case  two  subcases  are  possible: 

(a)  The  rank  of  1Za,b{I^)  is  already  N,  so  the  system 
is  reachable. 


for  which  a  direct-form  implementation  is  shown  in  Fig. 
4(a).  With  state  variables  as  indicated,  the  state  space 
description  (A,  B,  C,  D)  can  readily  be  identified,  yielding 


"0 

1 

0 

...  0' 

"0“ 

0 

0 

1 

...  0 

0 

A  = 

0 

0 

0 

...  1 

,  B  = 

0 

,0 

0 

0 

...  0, 

C=[a^“' 

Note  that  the  number  of  state  variables  iV  =  L  —  1.  From 
the  preceding  we  verify  that 


‘R'A,b{L) 


Sc,a{N)  = 


‘0 

0  ... 

0 

1 

0’ 

0 

0  ... 

1 

0 

0 

0 

1  ... 

0 

0 

0 

.1 

0  ... 

0 

0 

0_ 
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L-l 

a 

-1 

0 

a2 

0 

0 

1 

(b)  The  rank  of  7^>i,b(L)  <  rank  of  7^A,B(^f).  If  the 
latter  is  also  <  AT,  we  can  perform  the  usual  re¬ 
duction  and  reduce  the  size  N  of  the  state  vector. 
If  the  rank  of  7^>i,b(A^)  already  AT,  we  cannot  do 


Since  N  =  L— 1,  'IZa,b{L)  has  size  (L-l)xL  and  Sc,a{N) 
has  size  (L  -  1)  X  (L  —  1).  Both  of  these  matrices  have  rank 
AT  =  L  —  1  (assuming,  of  course,  a  0),  showing  that 
the  structure  is  both  reachable  and  observable.  Notice, 


2 


1 


however,  that  the  system  H{k)  can  be  rewritten  in  the 
recursive  form 

using  the  fact  that  W[;  =  1.  This  yields  the  simpler  re¬ 
cursive  implementation  requiring  only  one  cyclic  delay 
(Fig.  4(b)).  We  can  verify  that  the  state  space  description 
of  the  simplified  structure  is 

A  =  a,  B  =  l,  C  =  a(l-a^),  D  =  1  - 

In  this  case  the  number  of  state  variables  TV  =  1.  One 
readily  verifies  that  1Za,b(I)  =  1  and  Sc,aW  =  a(l  — a^). 
So  and  Sc,Ai^)  rank  N,  and  the  sturcture 

is  reachable  and  observable  (assuming  a  /  0  and  ^  1). 
Thus  the  two  structures  shown  in  Fig.  4  are  two  reach¬ 
able  and  observable  implementations  of  H{k)  with  differ¬ 
ent  state  dimensions!  The  first  one  requires  L  —  1  cyclic 
delays  (W^  elements);  the  second  structure  requires  only 
one  cyclic  delay. 

Example  2 

Consider  the  2x2  cyclic  system  shown  in  Fig.  5(a),  and 
assume  L  =  3.  The  number  of  state  variables  is  TV  =  4. 
The  state  space  description  has 


A  = 


■0  10  0' 

ro  01 

0  0  10 

,  B  = 

1 

1 

0  0  0  1 

0  0 

.0  0  0  0. 

C=[? 

0  10] 
o  n  n  1 

Li 

iJ 

Let  L  =  3.  Then  explicit  computation  shows  that 


HaMQ  = 


0 

1 

0 

LI 


Oil 
10  0 


1  1 


0  0  0  0, 


7^>^.fl(TV)  = 


ro  0  1  1 
110  0 
0  0 
Li  1 


0  0 
1  1 


1  1 
0  0 


1  1 
0  0 


0 

0 


0  0 
0  0 


«Sc,>i(2)  = 


ro  0  1  0 
10  0  0 
0  0  0  1 
Lo  1  0  0 


Thus  7^A,fl(L)  has  rank  3  <  N  which  shows  that  the  cyclic 
system  is  not  reachable.  However,  'IZa,b{N)  has  rank  4, 
Since  «Sc,a(2)  has  rank  4,  so  does  Sc,a{N)-  So  we  cannot 
perform  state-reduction  using  classical  techniques.  In  this 
example,  however,  it  is  possible  to  perform  state  reduction 
of  the  cyclic  system  by  simple  manipulations  of  the  struc¬ 
ture,  and  by  using  the  fact  that  =  1.  For  this  we  notice 
the  identity 

[1  l][i  ;][1  1) 

which  shows  that  the  transfer  matrix  of  Fig.  5(a)  is  even¬ 
tually 

U(k)  +  0 

-  [  0  Wi'‘  +  Wa'' . 

1  +  wi* 


][;  1] 
(1  1) 


which  has  the  implementation  shown  in  Fig.  5(b)  requiring 
only  two  cyclic  delays.  Thus  in  this  example,  IZA^BiN)  and 
^c,a{N)  have  rank  N  but  7^a,b(L)  does  not,  and  we  were 
able  to  reduce  state-dimension. 

In  Example  1  we  found  that  the  state  dimension  could 
be  reduced  even  though  the  cyclic  system  is  reachable  as 
well  as  observable.  In  Example  2  we  found  that  7^a,b(TV) 
and  Sc,a{N)  have  rank  N  and  1Za,b{L)  has  deficient  rank, 
and  the  state  dimension  could  again  be  reduced.  The  ques¬ 
tion  now  is,  what  is  a  necessary  and  sufficient  condition  for 
the  minimality  of  state  dimension  in  cyclic  LTI  structures? 
A  related  question  is,  can  we  develop  a  theory  paralleling 
the  Smith-McMillan  form  and  relate  the  minimum  state 
dimension  (McMillan  degree)  to  this  form?  These  appear 
to  be  fundamental  questions  requiring  further  work. 

2.3.  Unitariness  of  Reaiization  Matrix 

Suppose  we  are  given  an  implementation  for  a  cyclic  trans¬ 
fer  matrix  E(fc).  This  implementation  has  a  state  space  de¬ 
scription  of  the  form  (1).  The  realization  matrix  for  the 
implementation  is  defined  as 


The  following  result  proved  in  [10]  connects  the  cyclic- 
par  aunitary  property  to  unitariness  of  the  realization  ma¬ 
trix. 

Lemma  1.  If  the  realization  matrix  is  unitary,  then  the 
cyclic  system  E(A;)  is  paraunitary.  0 


3.  CONCLUDING  REMARKS 

We  conclude  by  making  explicit  the  connection  between 
three  related  problems  in  cyclic  LTI  system  theory: 

i.  Paraunitary  interpolation  problem.  Given  a  se¬ 
quence  of  unitary  matrices  E(/c),0  <  k  <  L  —  1,  does  there 
exists  an  FIR  paraunitary  matrix 

N 

Eintiz)  =  y^eint(n)2~” 

n=rO 


such  that  E(fc)  =  This  is  called  the  parauni¬ 

tary  interpolation  problem.  In  [10]  it  has  been  shown  that 
such  an  interpolant  Eint(2)  does  not  always  exist. 

2.  Cyclic  paraunitary  factorization  problem.  We  know 
that  any  noncyclic  causal  FIR  paraunitary  system  can 

be  factorized  into  degree  one  building  blocks  I  —  UjuJ  -h 

Uiujz"^  (where  Ui  are  unit  norm  vectors).  Can  a  cyclic  pa¬ 
raunitary  system  E(fc)  be  factorized  into  degree-one  cyclic 

building  blocks  Ui(fc)  =  I  —  Uiut  -i-  It  turns  out 

that  this  is  not  always  possible  [10]. 

3.  Unitary  realization-matrix  problem.  Lemma  1  is 
analogous  to  a  result  in  the  noncyclic  case  [8].  However, 
unlike  in  the  noncyclic  case,  we  do  not  have  the  converse 
result.  That  is,  even  if  E(fc)  is  paraunitary,  there  may  not 
exist  a  minimal  nonrecursive  structure  (i.e.,  minimal  struc¬ 
ture  with  all  eigenvalues  of  A  equal  to  zero),  with  unitary 
realization  matrix.  When  such  a  structure  does  exist,  the 
FIR  interpolant  Etnt(-2)  =  D  -1-  C(2l  —  A) “*^3,  obtained 
by  replacing  with  in  the  structure,  would  be  pa¬ 
raunitary  (because  the  converse  part  holds  in  the  noncyclic 


3 


case  [8]).  Since  cyclic  paraunitary  systems  do  not  neces¬ 
sarily  have  FIR  interpolants,  this  shows  that  G(A;)  does  not 
always  have  a  structure  with  unitary  realization  matrix. 

By  combining  the  preceding  arguments  we  can  show 
this:  Let  E(A:)  be  cyclic  paraunitary.  Then  the  following 
three  statements  are  equivalent:  (a)  there  exists  a  causal 
FIR  paraunitary  interpolant  Ei„t(z),  (b)  E(fc)  can  be  fac¬ 
torized  into  unitary  building  blocks  like  Ui{fc)  (and  a  con¬ 
stant  factor  representing  E(0)),  and  (c)  there  exists  a  cyclic 
recursive  implementation  for  E(fc)  such  that  the  realization 
matrix  is  unitary. 


Rg.  1.  Implementation  of  an  arbitrary  cyclic(L)  LTI  system. 


Rg.  2.  The  cyclic  direct-form  structure  for  a  first  order  filter. 
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Rg.  3.  The  points  on  the  unit-circle  correspond¬ 
ing  to  the  DPT  frequencies  (L=8). 


Rg.  4.  Example  1.  Two  Implementations  of  a  cyclic(L)  system. 
Both  of  these  are  reachabale  and  observable  implementations, 
(a)  L-1  state  variables  used  and  (b)  only  one  state  variable  used. 


(a) 


State  variables 


(b) 


x,(n) 


w: 


■y,(n) 


Rg.  5.  Example  2.  (a)  A  cycllc(3)  system  requiring 
four  cyclic  delays,  and  (b)  reduced  system  requiring 
two  cyclic  delays.  Classical  techniques  cannot 
be  used  to  perform  this  reduction. 


